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METHOD AND DEVICE FOR THE REAL TIME CONTROL OF PRINT 
IMAGES 

The invention concerns a method and a device for real-time monitoring of print 
5 images. 

In the production of print works, print errors can only be detected via purely visual 
observation at a later point in time due to the high speed with which print works 
are moved in printing systems. The visual monitoring of print images is in 
10 particular difficult with continuous printing, since it is not possible to single out 
and to check an advance copy. If misprints are detected too late or not at all, high 
costs arise. 

However, incorrectly operating monitoring devices that trigger an error alarm can 
15 also incur unwanted costs due to the shutdown of the printing path. 

Therefore there exists a significant need for a robust method that reliably, safely 
and quickly detects print errors in the operation of a printing path. 

20 Video cameras with stroboscopic illumination are used for what is known as online 
print monitoring. The images supplied by these cameras can then be visually 
monitored and supplied to an automatic monitoring unit. 

A known method for automatic monitoring of print works is described in DE 199 
25 40 879 Al. In this method, a reference image is generated or, respectively, 

provided if it already exists in digital form. A REAL [sic] image is detected by 
means of a stroboscopic light flash. The position of the REAL image is mapped on 
the reference image by means of a suitable correlation method. Since an exact 
superimposition of the reference image and the REAL image is not possible in 
30 practice, the reference image is sub-divided into sub-regions. The individual sub- 
regions can connect to one another without gaps or even overlap. The differences 
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of the color values of the pixels are determined in each sub-region. If the 
difference in a sub-region is greater than a predetermined tolerance threshold, the 
label "structure" is associated with the sub-region, and the label "color" is 
associated with the sub-region in the case that all differences in the sub-region are 
smaller than a predetermined tolerance threshold. The REAL image is compared 
with the desired color values in sub-regions with which the label color is associated 
based on the REAL color values. In sub-regions with which the label structure is 
associated, the average values or the sum of the amplitudes of all grey levels are 
determined and compared. 

This method has proved itself well in practice. However, there are fundamental 
disadvantages. Individual pixels of the REAL image are compared with the 
parameters of a sub-region that, given the label structure, do not precisely describe 
the color property. The quality of this monitoring method depends very much on 
whether the morphology of the printed image randomly coincides with the 
arrangement of the sub-regions. Since the individual regions are predetermined 
fixed, in particular long, narrow or short and wide sections of an image which 
possess a specific color property are not precisely monitored since they extend 
over a plurality of sub-regions, and in each sub-region the monitoring parameters 
to be determined have only a fractional influence. 

A method for comparison of print images is known from the document DE-A-199 
40 879, in which currently-acquired images are compared with a reference image. 
The images to be compared are stored in pixel data. A system for monitoring of 
colors of print images in known from the document US-A-6,024,018, in which the 
image to be monitored is separated into regions that are then evaluated. 

The invention is thus based on the object to achieve a method and a device for 
monitoring of print images with which the reliability and quality of the monitoring 
is significantly increased relative to conventional methods or, respectively, 
devices. 
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The object is achieved via the invention described in the independent claims. 
Advantageous embodiments of the invention are specified in the sub-claims. 

5 The inventive method for monitoring of print images comprises the following 
steps: 

electro-optical detection and digitization of a REAL image in individual 
pixels, 

use of a reference image that is segmented into a plurality of segments such 
10 that the segments respectively exhibit a specific color property, whereby a 

reference value describing the color property is associated with the pixels 
arranged in the respective segment, 

comparison of the color property of the pixels of the REAL image with the 
corresponding reference values of the reference image, whereby a 
15 corresponding pixel is marked as an error in a result image given a 

deviation above a predetermined threshold value, and whereby boundary 
regions of the segments are not considered in the comparison. 

In the invention, a reference image is used that is segmented into a plurality of 
20 segments such that the segments respectively exhibit a specific color property. 

Thus no randomly previously established sub-regions are used, but rather segments 
that in the reference image respectively comprise a region with an essentially 
identical color property. The segments thus reproduce the morphology of the 
image. Given this special design of the segments, significantly more precise 
25 reference values can be used than is the case in conventional methods in which the 
sub-regions have been randomly established. 

In the inventive method, the pixels of the REAL image are thus compared with a 
very precise reference value, whereby deviations can be very reliably detected. 

30 
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Color properties in the sense of the following invention can, for example, be grey 
values and/or color values. 

In particular a real-time monitoring of print images is possible with the invention. 

According to a preferred method, boundary regions of the segments are not 
considered upon comparison of the pixels of the REAL image with the 
corresponding reference values of the reference image, whereby small register 
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shifts (that are often unpreventable and are not viewed as errors by an observer) do 
not lead to unwanted error data. 

A result image in which the error data can be binarily [sic] associated with the 
5 individual pixels of the result image is generated with the inventive image. The 
result image can thus be shown as a binary image in which the regions are marked 
in which errors occur. Such a binary image can simply be shown on a display 
device and indicates the error locations of a printed image to an operator. The 
operator can hereby quickly and simply detect the errors and, in the event that it is 
1 0 necessary, take corresponding correction measures. 

Such a binary result image can also be very significantly compressed with known 
compression methods since it comprises only large-area binary (black/white) 
regions. This allows that the result images can be transferred to a monitoring 
15 station in real time over a data line with limited transfer capacity. The compressed 
result images can be uncompressed again at the monitoring station and shown on a 
display device. 

The invention also provides a method for segmentation of a reference image in 
20 which regions with the same color property are determined, whereby these regions 
respectively form a segment. A reference value that describes the color property of 
the respective segment tomography imaging system respectively associated with 
these segments. 

25 The invention is subsequently, exemplarily explained in detail using drawings. 
The drawings show: 

Figure 1 schematically, in a flow diagram a method for real-time monitoring 
of print images, 

30 
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Figure 2 schematically, in a flow diagram a method for segmenting a 
reference image, 

Figure 3 a method for segmenting a reference image using some few [sic] 
5 pixels, 

Figure 4 a printing system in which the inventive method is used 



Figure 5 a reference image, 

10 

Figure 6 the segments of the reference image from Figure 5, 



Figure 7 a REAL image, 



15 Figure 8 a result image, 



Figure 9 a further reference image, 



20 



Figure 10 the image from Figure 9 after the segmentation, 

Figure 1 1 the image from Figure 10 after the connection of individual 
segments, and 



Figure 12 the edges of the segments of the images from Figure [sic] 9 through 
25 11. 



30 



The inventive method for real-time monitoring of print images is used in a printing 
system (Figure 4). Such a printing system comprises a printing device 1 . The 
inventive method is typically used in high-capacity printers and in particular 
printers printing on continuous paper. Such a continuous paper is drawn from a 
paper roll 2 and supplied to the printing device 1. A post-processing device 3 in 
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which, for example, the continuous paper is cut into individual sheets is typically 
downstream from the printing device 1 . The paper is conducted from the printing 
device 1 to the post-processing device 3 along a paper track (schematically 
represented in Figure 3 by two roller pairs 4). 

5 

A line camera 5 that is directed (with its objective) towards the printed paper web 
is arranged on the paper track. The passing paper can be electro-optically detected 
with such a line camera and these digital images can be individually created on the 
paper web of printed pages [sic]. These digital images respectively represent an 
10 REAL image. 

Instead of a line camera, a different electro-optical detection device can also be 
used such as, for example, a camera for acquisition of a two-dimensional image in 
combination with a stroboscope, whereby the paper web is illuminated with light 
15 flashes emitted by the stroboscope such that individual pages of the moving paper 
web are respectively recorded. 

The camera 5 is connected with an evaluation device 6 that is typically a computer 
with a storage device and a central calculation device. The evaluation device 6 is 
20 connected with a display device 7. 

The REAL image generated by the camera 5 is stored in an image storage in the 
evaluation device 6 (step S2). 

25 The position of the stored REAL image is determined relative to a desired position. 
This can occur using register markings or specific identifiers in the image itself. 
Diverse correlation methods for this are known in the prior art. An affine 
transformation with which the individual pixels of the REAL image can be mapped 
to the desired position is determined using this position determination (step S3). 

30 
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Afterwards the individual pixels of the desired image or, respectively, their color 
properties are compared with the reference values of a reference image (step S4) in 
a loop. In this comparison, the pixel that should be compared with the reference 
image is initially mapped to the corresponding location in the reference image by 
5 means of the affine transformations. The reference image is divided into segments. 
This division is explained in detail below. A reference image is associated with 
each segment. In this comparison, it is established in which segment the affine- 
transformed pixel lies, whereby the reference value associated with the segment is 
then used for the comparison. If the color property of the pixel of the REAL image 

10 deviates from the correspondingly-selected reference value by a predetermined 
threshold value (result of the comparison: no), this means that the pixel does not 
possess the desired color property. In such a case, in a result image a pixel is at the 
corresponding position in the image is associated with a value the represents the 
error (step S5). If the color property of the pixel of the REAL image is within the 

1 5 range around the reference value that is predetermined by the threshold value 
(result of the comparison: yes), this means that this pixel possesses the desired 
color property, and the corresponding pixel in the result image is associated with a 
value that designates the correctness of this pixel. For example, in the result image 
the error values are set with a "1" and the correct values are set with a "0". 

20 

Afterwards it is checked whether all pixels of the desired image have been 
compared with corresponding reference values (step S7). 

The result image is prepared in the steps S8. Individual pixels or a few pixels that 
25 are contiguous and marked as wrong are set back to the correct value. A single 
pixel or a few contiguous pixels (whereby their number depends on the resolution 
of the image) are not detected by an observer of a printed image and are therefore 
nor considered in the present method. 

30 The result image is shown on the display device 7 (step S9) so that the result image 
can be observed by the operator of the printing system. 
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As an option it can be provided to compress the result image after its preparation in 
order, for example, to transfer it over a local network to a monitoring station at 
which the result image is decompressed and shown on a display device. It has 
5 been shown that the binary result image, which is typically comprised of large-area 
regions with error values or, respectively, correction values, can be very 
significantly compressed and therefore can be quickly and simply be transferred as 
a small amount of data, even over data lines of lower data capacity. 

10 The color properties can be represented by grey values and/or by color values in 
the method described above. If color values are used, a color property can thus be 
described by a plurality of values. If, for example, the color property is 
represented in RGB space, a color value for red, green and blue are [sic] to be 
specified for each color property. Given such multi-dimensional color properties, 

15 an interval value is used as a threshold value. This can, for example, be a specific 
Euclidian interval in the color space. However, it can also be appropriate to 
correspondingly vary the interval according to human perception, which is 
developed significantly differently with different colors. For example, for this the 
RGB data of the REAL image are transferred into a color space which takes into 

20 account the properties of human color interval perception (for example CIELa*b*) 

The desired values are then likewise provided in such a color space so that the 
Euclidian interval can also be used here. 

25 However, there are also color interval measures that cannot be calculated in a 
Euclidian manner. Here a more complex calculation is then necessary. The 
determination of these interval measures is established in standard lettering. 
However, the bases are nevertheless specially-selected color spaces. 

30 In a preferred embodiment of the invention, the boundary regions of the segments 
not considered in the comparison of the pixels of the REAL image with the 
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corresponding reference values in step S4. This is appropriate since, in spite of the 
affine transformations, remaining congruence errors can arise. These can arise due 
to uncertainties of the spatial determination or non-linear variations of the REAL 
and desired images against [sic] one another, for example via hygroeexpansivity 
5 [sic] or sagging. This means that individual pixels in the boundary region could be 
incorrectly associated with an adjacent segment, whereby a false evaluation of the 
pixel would result. These problems in the boundary region are thus remedied by 
the non-consideration of the boundary region. The width of the boundary region 
depends on the resolution of the reference image. Suitable widths of the boundary 
10 region lie in the range from 1 to 10 pixels, preferably in the range of 1 to 4 pixels. 

The association of the reference values is achieved in a program-technical manner 
in that a label is associated with each segment and the color property is associated 
with each label. If the color property is a grey level, this association can, for 
1 5 example, be represented according to the following table: 



Label 


Grey level 


0 


nop 


1 


100 


2 


130 


3 


215 


4 


190 


5 


160 


6 


235 


7 


80 1 


8 


55 


9 


30 


10 


255 



The label 0 is associated with the boundary regions and a code "nop" (which 
means "no operation") is associated with the label 0 instead of a grey level. If a 
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pixel lies in the boundary region, upon comparison the code for "no operation" is 
hereby invoked, whereby the comparison is not executed. The corresponding grey 
levels are respectively invoked for the further labels 1-10. In the comparison 
itself, the absolute value is established between the grey level of the reference 
5 value and the grey level of the pixel to be compared and it is checked whether this 
absolute value is smaller than the threshold value. If this is the case, the grey value 
of the pixel thus lies in the desired range and the correct value is set in the result 
image. Otherwise the error value is set in the result image. 

10 If color values are used instead of the grey values, a set of color values that 
describe the respective color are respectively associated with each label. 

A method for segmenting a reference image is subsequently explained (Figure 2). 
A reference image must initially be provided (step S10). The provision or, 
15 respectively, generation of a reference image can occur in that an error- free 

printout of the image is recorded with the optical detection device 5 (which is also 
used to record the REAL image) in order to generate a digital image file from the 
image. 

20 On the other hand, in the event that the image to be printed already exists as a 

digital image file, it is also possible to use this image file directly. However, it is 
hereby appropriate to adapt the resolution (i.e. the number of the pixels per 
lengthwise unit in each row and column) of this image file to the resolution of the 
REAL image. As a rule, the resolution of the REAL image might be somewhat 

25 less than that of the image file serving as a master copy, which is why the 

resolution is reduced in a corresponding manner by means of suitable and known 
interpolation methods. 



30 



Afterwards contiguous regions in the reference image are determined that possess 
approximately the same color properties, whereby one such region respectively 
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forms a segment (step SI 1). This can, for example, be executed according to the 
following: 

The pixels are individually, respectively associated with a segment, 
whereby the pixels in each row j (Fig. 3) are processed from left to right, 
5 the individual rows in succession from top to bottom. 

The reference values of the three adjacent pixels in the row above this pixel 
and the reference value of the adjacent pixel to the left of the pixel to be 
associated are read out from a pixel to be associated with a segment. If the 
pixels are arranged in rows j and columns i, relative to the to-be-associated 

10 pixel with the coordinates (i, j) the reference values of the pixels with the 

coordinates (i-, j-1), (i, j-1), (i+l,j-l) and (i-l,j) are read out 
It is subsequently determined which of the four reference values is most 
similar to the color property of the pixel to be associated. 
If the difference of this reference value and the color property of the pixel 

15 to be associated is less than a predetermined threshold, the pixel to be 

associated is associated with the segment that contains the pixel whose 
reference value is nearest to the color property of the pixel to be associated. 
This association occurs in that the pixel to be associated [sic] the label of 
this segment is plotted in the reference image. 

20 

If the color property of the pixel to be associated differ [sic] from the closest 
reference value by more than the threshold, this pixel can be associated with none 
of the adjacent segments. This pixel forms the core for a new segment, whereby a 
new label of the association table is generated and this new label is registered in 
25 the reference image at the location of the pixel. 

The color property of the one pixel that has initiated the formation of the new 
segment is initially associated with the new label in the association table. This 
color property can be associated with this label as a reference value (step SI 2). 
30 Alternatively it is possible to use the average value of the color properties of the 
individual pixels of a segment as a reference value. Upon addition of a new pixel 
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to a segment, its color property is hereby averaged with the previously determined 
reference value of the segment with the corresponding weighting. 

If the reference image is completely segmented, the reference image is comprised 
5 of contiguous regions whose pixels are respectively associated with a specific 
label. The label for the boundary region, namely the label "0", is now associated 
with the pixels of the boundary regions of the segments (step SI 3). 

According to a preferred embodiment of the invention, it is examined whether 
10 segments exist that comprise less than a predetermined number of pixels and 

therewith are smaller than a predetermined size. If such segments are present, it is 
checked whether the color properties of adjacent segments do not differ from the 
color property of this small segment by a predetermined second threshold. If this 
is the case, both of these segments are joined into a single segment, whereby a new 
15 label is associated with this new segment. The weighted average value from the 
reference values of both original labels [sic] is associated with this new label as a 
reference value. With the joining of small segments with further segments, the 
division into very small segments is prevented insofar as it is possible since such 
small segments are not advisable for the monitoring of the print image, in 
20 particular when a boundary region is provided that is not checked. 

Figure 5 shows a reference image that comprises two rectangles. The upper 
rectangle is completely black and the lower rectangle exhibits a color gradient of 
black/white in the direction from bottom to top. Figure 6 shows the boundaries of 

25 the segments of the reference image shown in Figure 5. The black rectangle forms 
a single segment 9. The lower rectangle with the linear color gradient is divided 
into a plurality of stripe-shaped segments 9 whose reference value describes the 
average color property of the respective stripe, i.e. the average brightness or, 
respectively, the grey values of this stripe. Figure 8 shows a REAL image in 

30 which certain regions 8 are not correctly printed. The result image (Figure 8) that 
has been determined according to the method explained above [sic] these 
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incorrectly-printed regions 8 are shown in black and the remaining area of the 
result image is white. An operator of the printing system who sees the black 
regions of the result image immediately recognizes that a misprint exists and can 
initiate suitable measures to correct the misprint. 

5 

Figure 9 shows a further reference image. Figure 10 shows the reference image 
from Figure 9 after the segmenting according to step SI 1 . A specific color 
property is associated with each segment. The individual segments are here 
respectively represented by the color property that, in the present case, is a grey 
10 level. However, the representation of the color properties here occurs with false 
colors, meaning that the brightness of the individual segments in Figure 10 allows 
no conclusions about the actual grey level of the respective segment. Many small 
"specks" that respectively form a segment are recognizable in Figure 10. 

15 Figure 1 1 shows the image segmented according to Figure 10 after the joining of 
segments according to the step SI 4. Here it is clearly recognizable that many 
regions with small differing specks have been connected into large-area, uniform 
regions. 

20 The image according to Figure 1 1 was processed further in that, according to the 
step SI 3, the label 0 has been associated with the boundary regions that have been 
detected. The boundary regions are shown white in Figure 12. The remaining 
regions are shown black. Using Figure 12, one can easily recognize that the 
segmentation corresponds to the original morphology (Figure 9) of the image, [sic] 

25 As is explained above, a significantly better quality and reliability is hereby 
achieved in the automatic monitoring of printer works. 

The inventive method is executed on the printing system shown in Figure 4. The 
method can be realized as a computer program that is stored on the computer of the 
30 evaluation device such that it can be executed. This computer program can be 
stored on a data medium and be executed on other printing systems. 
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The invention can be summarized in brief according to the following: 

The quality in the automatic monitoring of print images in real time is improved 
5 with the invention in that a reference image is used that is segmented such that the 
pixels of the segments possess approximately the same color property. The 
segments of the reference image hereby approximately reproduce the morphology 
of the reference image, whereby a reference value that describes the color property 
of the segment very well is associated with each segment. The pixels of the REAL 
10 image are respectively compared with the reference value of the corresponding 
segment. This comparison is very reliable due to the high quality of the reference 
value. 
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Reference list 



1 


printing device 


2 


paper role 


5 3 


post-processing device 


4 


roller 


5 


line camera 


6 


evaluation device 


7 


display device 


10 8 


misprint region 


9 


segments 



Method steps 



15 SI acquisition of the REAL image 

52 storage of the REAL image 

53 position determination of the REAL image 

54 comparison of the pixels of the REAL image with the reference 
values 

20 S5 setting of the error value 

56 setting of the correct value 

57 Have all pixels been compared? 

58 preparation of the result image 

59 representation of the result image 
25 S 1 0 provision of a reference image 

511 segmentation 

5 1 2 association of the reference value 

5 1 3 determine boundary regions 

514 joining of segments 



30 



